A tutorial on a practical Bayesian alternative to null-hypothesis significance testing.
نویسنده
چکیده
Null-hypothesis significance testing remains the standard inferential tool in cognitive science despite its serious disadvantages. Primary among these is the fact that the resulting probability value does not tell the researcher what he or she usually wants to know: How probable is a hypothesis, given the obtained data? Inspired by developments presented by Wagenmakers (Psychonomic Bulletin & Review, 14, 779-804, 2007), I provide a tutorial on a Bayesian model selection approach that requires only a simple transformation of sum-of-squares values generated by the standard analysis of variance. This approach generates a graded level of evidence regarding which model (e.g., effect absent [null hypothesis] vs. effect present [alternative hypothesis]) is more strongly supported by the data. This method also obviates admonitions never to speak of accepting the null hypothesis. An Excel worksheet for computing the Bayesian analysis is provided as supplemental material.
منابع مشابه
An Introduction to Bayesian Hypothesis Testing for Management Research
In management research, empirical data are often analyzed using p-value null hypothesis significance testing (pNHST). Here we outline the conceptual and practical advantages of an alternative analysis method: Bayesian hypothesis testing and model selection using the Bayes factor. In contrast to pNHST, Bayes factors allow researchers to quantify evidence in favor of the null hypothesis. Also, Ba...
متن کاملBayesian point null hypothesis testing via the posterior likelihood ratio
Neyman-Pearson or frequentist inference and Bayes inference are most clearly differentiated by their approaches to point null hypothesis testing. With very large samples, the frequentist and Bayesian conclusions from a classical test of significance for a point null hypothesis can be contradictory, with a small frequentist P -value casting serious doubt on the null hypothesis, but a large Bayes...
متن کاملBayesian Analysis
A Bayesian analysis concerns the quantification and updating of knowledge according to the laws of probability theory. A Bayesian analysis allows researchers to estimate parameters (e.g., how effective is a new treatment?) or to conduct hypothesis testing and model selection (e.g., is the new treatment more effective than the standard treatment?). The Bayesian paradigm offers concrete advantage...
متن کاملBayesian Testing of a Point Null Hypothesis Based on the Latent Information Prior
Bayesian testing of a point null hypothesis is considered. The null hypothesis is that an observation, x, is distributed according to the normal distribution with a mean of zero and known variance σ. The alternative hypothesis is that x is distributed according to a normal distribution with an unknown nonzero mean, μ, and variance σ. The testing problem is formulated as a prediction problem. Ba...
متن کاملThe importance of determining the clinical significance of research results in physical therapy clinical research.
Clinical research in physical therapy is fundamental to generate new knowledge and validate our therapies. The evaluation of research findings is crucial to help clinical decision making and to comply with the principles of evidence based-practice. Statistical significance testing has dominated the way researchers typically report their results and evaluate their significance. This approach has...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Behavior research methods
دوره 43 3 شماره
صفحات -
تاریخ انتشار 2011